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Field o f the Invention 

Tj^s invention is concerned with interactive communication systems linking central 
locations having access to stores of data and images used for medical purposes and a 
plurality of outlying users of the images and data for medical review, processing, 
assessment and diagnostics. 

Background o f the Invention 

Modern hospitals and health centers today usually have several computerized systems for 
medical information gathering; exchange, storage and processing. Herein such a system is 
referred to as a "data source". Medical information may come in textual, voice, sound, 
graphical, and image modalities. Such medical information may be required by 
authorized personnel, including those located outside the hospital premises, and 
equipped with computers of some sort Herein the requiring side is referred to as the 
"user". In present systems the users are equipped with their own software to access the 
data source. Difficulties in the use of such computerized systems are caused by such 
things as the varied networking procedures required to fetch the data, the lack of an 
industry standard, the lack of an easy to use user interface and, in the case of image data 
transfer, the channel bandwidth requirements along with the typically large volumes of 
the image information, which in turn translates into very long transmission periods. In 
addition to that, a typical user might be required to master the skills of operating a large 
number of software systems like those used with various data processors, the varied 
communication software, software installations procedures, etc. The system administrator 
needs to install the different types of application software in large numbers of computers, 
and update this software, in each computer, every time a new version is used. This 
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proliferation of software and hardware in the medical data processing systems make such 
systems difficult to maintain and a burden to update. 




Presently / more and more hospitals and clinics are uniting for economic reasons to 
form healthcare enterprises with consolidated resources, having a single headquarters for 
managing the organization. The consolidation of resources also takes place inside 
individual hospitals, with the primary goal of facilitating data exchanges inside the 
hospital, with hospital personnel outside the hospital premises, as well as with other 
related facilities and with the enterprise headquarters. Generally, most individual 
facilities that make up the enterprise operate special systems to store and manage various 
parts of their clinical data. One can generally view these systems as being composed of, 
data acquisition devices, data storage devices (data banks), and data management and 
communication modules. The users are connected to the data banks via various 
networking procedures and communications protocols. These users may operate a variety 
of computer hardware systems. Access of each user to stored patient data is presently 
done through the use of special application software on the user' s computer. Since 
presently, most health and medical organizations have constructed their information 
systems and communications network over a period of time, access to these systems is 
often complicated, and sometimes requires the user to master several application, 
software and communication protocols. Typically, no common access method or user 
interface is available to the user, and users are often confined to the use of particular 
hardware at a specific location to access the data. The need to access image data further 
complicates the situation. The large bandwidth required from the communications link, 
the large data volumes, and the special processing that is usually needed, often requires 
the use of special software and hardware on the user's side . 
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Thus, one problem encountered with the present server-user communication 
systems for transferring medical data is the many different interfaces, software 
^plications, and communication protocols required and the many different types of work 
stations that make up the "installed base". Due to this proliferation of different work 
stations requiring different software applications, interfaces and communications 
protocols, then whenever a new improved system or a new data type become available, 
the many different work stations have to be equipped with the software for u ti l izin g the 
new systems or data. This is not only expensive, but time consuming in that the 
installation of the software in each of the many different work stations and the central 
server requires time and usually requires expertise beyond that of the doctor or medical 
professional using the workstation. 

A second and equally troublesome problem is encountered when the data 
requested by the user includes images that must be transmitted over a given enterprise 
network. This is due to the long time required for transmitting image data as compared 
to other forms of data. Image compression is used to reduce transmission times. For 
clinical image data, special precautions must be taken if lossy compression is 
implemented, due to the potential loss of possibly vital findings. Lossless compression 
schemes are therefore employed, which provide a relatively small reduction of image 
transmission time (a factor of 2-3 for radiology images). Interactive compression schemes, 
that optimize the transmission time for any given user and user type are currently not 
available in existing healthcare information systems. Such an interactive compression 
scheme is presented as part of this invention. 

-~ The above can be summarized in a conceptual diagram (Fig. 1). An enterprise wide 
healthcare information system 11 may be conceptually conceived as comprising several 
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local facilities, 12-14, connected to a central facility 16. Each local facility comprises data 
sources 17 connected through appropriate interfaces such as interface 18, to the local 

ork, to which the various local users 19 are connected too. The local network of each 
local facility is in turn connected to the central facility through another interface (possibly 
including firewalls and security features). The central facility comprises a similar 
structure, with the addition of central repositories 23, data bases, and data management 
tools. This structure of the presently available systems suffers from the problems 
described above. Thus those skilled in t^ie art are still searching for effective solution to 
the existing problems. 

Brief Description of the Invention 

This invention provides systems and methods for largely overcoming the above problems, 
among other things, by adding data distribution servers, such as local server 24 and 
central server 26 as indicated in Fig. 2. The concept detailed in Fig. 2 is logically 
summarized in Fig. 3. The various clinical data acquisition devices and data banks are 
conceptually grouped into a "data source" block 28. A server 29 is introduced as an 
intermediate level between the data source and the users. The introduction of the server, 
with the appropriate functionality and data handling algorithms, alleviates many of the 
problems presented above. 

While the concept and method introduced here is applicable for the distribution of 
any type of clinical and non-clinical information, this invention will focus on solving the 
problem of distributing clinical images over the network, which poses one of the major 
obstacles in implementing a complete and comprehensive healthcare clinical information 
system. 
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The present medical image data communications and networking system 
overcomes the above described and other problems by providing an interactive and 
e^^ient method for a user to obtain images for diagnostic, review and processing 
purposes from a server having access to a plurality of stored images. The method 
comprises the following steps: 

connecting a user's computer to a server over a communications networks, 

interfacing the computer and the user (e.g. installing an industry standard browser 

software, such as Netscape, Explorer, etc., on the user 7 s computer), 

using a program in the server to receive from the server special software (applet) 
for the user's computer necessary for data selection and processing, 

selecting data for transmission from the server to the user' s computer, 

compressing the data for transmission by selectively using either lossy or loss-less 
compression algorithms, 

progressively transmitting the requested data over the network, 

receiving and decompressing the compressed data using the applet and producing 

preview images of progressively improving resolution, and 

using the preview images for selecting parts or a subset of the images for continued 
transmission to reduce the required transmission time. 
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The above enumerated and other problems are overcome, by using, for example, 
the internet to connect the user and the server. The user's computer does not need any 
^tavare for receiving or processing the requested image except the standard browser 
software. Instead, the necessary software is transmitted from the server along with the 
image using a network computing language such as Java or ActiveX or similar language. 
Accordingly, if and when there are changes or improvements made in the data, the 
software or the image processing procedure, it is no longer required for a technician to go 
and install the necessary software or modify the existing software on each user's 
computer. Instead this is accomplished using the Java or ActiveX type language. 

The second problem, that is the time required for transmitting of images is 
overcome by progressively sending "layers" of the data so as to make preview images 
which are not necessarily of high resolution quality, but as more and more layers of data 
are sent the resolution progressively improves . The user will be able to decide to get only 
a certain portion (Region of Interest - ROI) of the image rather than the whole image, or to 
entirely discard the image by stopping the transmission. In addition, based on the 
preview images, the user may decide to request only a subset of an image set .Further 
time savings result from using segmentation whereby background in the image is 
automatically detected and omitted. Also, a lossy compression can be used for the 
preview image, and upgrading to full resolution and quality can be done on specific 
request Therefore, in the process of image viewing, much less data may be transmitted 
than in the present systems and time savings can be considerable. This greatly alleviates 
the problem faced when transmitting clinical images from a server to a user for diagnostic 
purposes. 
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Hence, the system described herein overcomes the above mentioned difficulties by 
applying a coding scheme which includes lossy and loss-less algorithms, with pyramidal 
sffccturing of the images for progressive transmission. A simple yet general man to 
machine interface (MMI) enables the user to activate the compression algorithms 
interactively, according to on-line requirements. Today's network computing software 
(such as Java or ActiveX) enable a simple procedure by which the user' s software is 
installed by a networking service program on the server, and there is no installation 
requiring user intervention on the user side (except a one time installation of an industry 
standard browser software). - 

A sample compression-decompression scheme for the treated images to be used on 
a wide range of communication networks is presented. This scheme can treat both 
volumes (group of images) and single images applying loss-less or lossy coding, 
according to requirements posed by the user and the available resources. A progressive 
approach is applied within the compression-decompression scheme, which enables the 
user to get previews or overviews of the transmitted image long prior to the time required 
to transmit the entire image. The quality of the overviews improves over time thus 
enabling the user to get basic impressions of the. transmitted data long before the entire 
image has arrived. The basic impressions enable the user to interact with the server so that 
only the actually necessary data is really sent to the user. A typical session of requesting a 
medical image from a medical image store involves a series of decisions regarding image 
and region of interest selection. The progressive, interactive approach enables the user to 
make many of these decisions before the entire image-set is received. This further reduces 
the time required to get the needed images and improves the resource utilization by 
transmitting, in full description, only that part of the data which is really of interest 
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The compression-decompression scheme is designed to be asymmetric, namely, the 
computational requirements on the server/coding side are much greater compared to the 
^juirements on the user/decoding side. This is in accordance with the assumption that 
the server's side of the system is implemented on a relatively powerful computer while 
the user's hardware requirements are minimal (the user's work station can also be a 
simple Personal Computer). 

The coding scheme described herein utilizes various properties of the typical 
medical images, for coding benefit Medical images often contain an informative part 
surrounded by a background which is of less medical importance. The proposed coding 
scheme takes advantage of this particular image structure by using segmentation of the 
image prior to transmission, in order to avoid transmitting the information-less 
background. The background information is coded and transmitted only upon a specific 
user's request and/or after the informative part of the images has arrived at the user. 

Medical images are typically acquired using more than 8 bits per pixel. Many if not 
most of potential users are only able to display color or gray level information at 8 bits per 
pixel. For that reason a lossy version of the image can be obtained by dynamic range 
reduction using simple well known techniques generally referred to as "windowing", or 
more complicated adaptive techniques, such as adaptive "windowing". Those lossy image 
versions are much smaller in size than the original image and can be transmitted 
relatively fast, enabling the user to display a lossy version of the image in a short time. 
This lossy version serves as a preview or overview image and also as a basis for further 
improvements of image quality. As an overview image it enables the user to decide what 
part of the image set and image region is really required. The interactive nature of the 
user/server protocol enables the client to dynamically specify which part of the image set 
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is needed. Only the needed part will be fully transmitted; thus, reducing the required 
transmission periods. 

Because of the progressive nature of the coding schemes, the images at the user' s 
side are available for on-line processing during transmission. Various enhancement, 
display, and analysis techniques are supported. Interactive graphics on the user's side 
enables the viewer to define a region of interest in order to confine the transmission to 
that specific area. 

It should be understood that, in a preferred embodiment, the interactive 
communication system also interfaces to clinical information systems available to the 
server enabling the transfer of data that includes, for example, medical reports, medical 
history, laboratory results and test results. 

Brief Description of the TDrazvings 

For a more complete understanding of the invention, reference should be made to the 
following detailed description which is given in conjunction with the accompanying 
drawings, of which: 

Figure 1 - is a conceptual representation of a present prior art enterprise wide healthcare 
information system, 

Figure 2 - adds data distribution servers to the enterprise healthcare information system to 
facilitate enterprise wide data transfer, 

Figure 3 - presents a logical representation of the data distribution server concept of fig. 2. 
Figure 4 - is a general block diagram of a preferred compression-decompression scheme; 
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Figure 5- is a showing of the reduce and enlarge operations in the pyramidal 
decomposition; 




Figure 6 - is a showing of the pyramidal structure concept; 

Figures 7a and 7b - illustrate the background transmission approach; 

Figure 8 - illustrates the order of transmission; 

Figure 9a - illustrates a predictor for a single image; 

Figure 9b - illustrates a predictor for a group of images; and 

Figure 10 - illustrates an example of vector partitioning. 

General Description o f the Preferred Embodiment 

1. System Overview 

The system consists of a server that has access to data banks and distributes the data on 
demand. Several users can connect, simultaneously, to the server, over communication 
lines. In this system the server is also responsible for image pre-processing and for 
distributing user software. The user's function is to manage the medical image acquisition 
and processing through the use of an intuitive Man-Machine Interface, a special protocol 
and the available hardware and communication resources. 

A typical medical image acquisition session will start by a simple data request, 
made by the user, to the system's server communication site. This generic request can be 
accomplished using any of standard communication protocols and, for example, through 
an HTTP (Hyper Text Transmission Protocol) connection to the server (which can be 
designed for access purposes as a Web (www) site. There are no requirements on the 
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user's hardware and browser software other than the basic capability to communicate 
over the chosen communication line and for the browser to support a network computing 
^mguage such as Java or activeX. Using the Web, these requirements will include a link to 
the Internet and a standard Web browser as described above. Upon such a request, the 
server will download, to the user's machine, a network application applet This network 
application will serve as the user's application in all future interactions with the server. 
The network application is a generic, platform independent application written in a 
suitable network application language such as, but not limited to, Java or ActiveX. The 
network language may also be any other software that utilizes the communication 
capabilities of the user's machine. After a short authorization and authentication 
procedure, the user will be presented with an opportunity to request medical data. The 
communication can also be accomplished using "dial-up" or other "networking" schemes. 

Medical data includes Medical Image Data, throughout this description. It may 
comprise a number of medical images, of various modalities, which are available for 
transmission through the server. The user may define the specific medical case of interest 
through the use of network application queries into the server' s database. Selecting the 
case is done using case identifiers which are usually, but not limited to, textual, image 
icons, etc. A typical CT (Computerized Tomography) case may contain 50-100 medical 
images. The actual transmission of the medical image information is accomplished 
through the use of a compression/ decompression algorithm and a powerful client/ server 
protocol. The transmission is relatively fast owing to a smart utilization of the available 
hardware and network resources and focusing on the needed medical information by 
providing the user with interim information, thus letting the user refine the information 
query parameters during the acquisition process itself. The compression-decompression 
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algorithm is basic to the explanation of the user/server acquisition protocol. Therefore, 

s general description will start with an explanation of the compression-decompression 
algorithm followed by a discussion of the acquisition protocol and conclude with a more 
detailed review of the Man-Machine Interface. 

2. The Compression-Decompression Algorithm 

The goal of the compression-decompression algorithm is to achieve maximal compression 
ratios but at the same time supply the user with visually adequate interim images. The 
algorithm should also support loss-less as well as lossy interim and final results, be suited 
to the medical image processing common to these images and as much as possible be 
asymmetric and easy to implement using the network computing language. 

Figure 4 presents an overview of the compression-decompression algorithm for use 
with the system described. Compression starts by (optional) segmentation (block Al in the 
figure 4), where the background of the image (if it exists) is separated from the actual 
image. 

Figures 7a and 7b show graphical presentations of such possible background 
segmentations. The regions denoted A, B, C, and D in figure 7a are background regions. 
The proposed segmentation bounds the region of actual tissue by a rectangle. Only the 
inner part is progressively transmitted. Other methods of segmentation are possible as 
shown in figure 7b where the actual tissue is shown peripherally bounded by the dashed 
lines. 

The second step (optional) in image coding for compression is a windowing 
operation (block Bl in figure 4), where the dynamic range of the input image is reduced to 
a lower number of bits per pixel. The new number of bits can represent the client's 
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display capabilities or be derived from the communication bandwidth restrictions. The 
^indowing operation could be done, for example, by estimating the average M and the 
standard deviation S of the image values, and rescaling these values in the range [(M - S / 
2) - (M + S / 2)] using the required new number of bits. As an alternative, an improved 
locally adaptive windowing method can be applied, which estimates the mean and 
standard deviation locally. Other well known windowing procedures can be used. 

Since one of the goals to be accomplished is to supply the user with meaningful 
interim results, the medical images are sejit progressively. This requirement in turn 
implies that a pyramidal re-structuring of the image is required (block CI in figure 4). The 
concept of pyramidal decomposition of an image is shown in figure 6, where the two basic 
operations - Reduce and Enlarge - are further described in figure 5. The reduce operation 
revises or decomposes the image by, for example, simply discarding all even rows and 
columns, creating an array that is a quarter of the original size. The enlarge operation, for 
example, bilinearly interpolates the image, resulting in an array four times larger. The 
interpolation process is not limited to a bilinear interpolation. The exact type of 
interpolation is selected based on the user's computational and display capabilities. The 
pyramidal structure contains at the zero- level one small image with reduced resolution. 
All the remaining levels contain residual values with increased resolution. The pyramidal 
decomposition of the image could also be achieved through the use of other pyramidal 
decomposition algorithms. The pyramidal data structures consist of several versions of the 
original image. Each version is of different size and nature. The pyramidal information is 
ordered such that the top of the pyramid is the version of the original image which least 
resembles the original image. If the pyramid is loss-less the final level of the pyramid is an 
exact replication of the original image. It is clear that after decompressing a specific level 
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we can reconstruct the image up to that level and get an interim result This interim result 
^embles the original image according to the level of the pyramid. 

In order to facilitate an efficient coding scheme, further decorrelation of the data is 
required. This is achieved by spatial and temporal decorrelation operation (block Dl in 
figure 4). At this stage, each pixel in the current resolution level is predicted by its spatial 
casual (already transmitted) neighbors. If groups of images are being coded together, 
temporal neighbors from previous images are used to compute a second predictor, and 
the best predicator is chosen for each block of pixels. At the end of the prediction stage, 
the residuals are rescanned into a vector. If the user selected only part of the image to be 
transmitted (ROI - Region of Interest) only that part of the residual image is scanned and 
the ROI parameters are added to the header of the image 



Following is an example of a predictor for a single image (Fig. 9a): 



_r/ v> w max (a,b) c<min (a, 

x-t(a, b /C ,)- min (a b) c >max (a. 

a+b+c otherwise 



,b) ^ 
e J 



Using similar reasoning a predictor for a group of images can be effective in case there is 
correlation between successive images (Fig. 9b): 

x=f(a,b,c,al,bl,cl,xl) 
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The residual vector is partitioned into variable length sub-vectors with a relatively 
^^>mogeneous probability distribution function (block El in figure 4). The adaptive 
partitioning is accomplished by estimating the local mean and variance on the vector, and 
sectioning the vector on high transients. Each sub-vector is then coded using an entropy 
coder. One example of such coding is a Golomb-Rice code (block Fl in Fig. 4). An example 
of a possible partitioning is shown in Fig. 10. 

The decompression algorithm is basically the compression operations in inverse 
order. First, a header is obtained, stating jvhether segmentation and/ or windowing 
operations were applied, the size of the images and their number, the pyramid depth, etc. 
(block A2 in figure 4). A zeros pyramid is then constructed in order to be filled during the 
decoding process (block B2 in figure 4). Each sub-sector is decoded using inverse entropy 
coding, i.e., Golomb-Rice code (block C2 in figure 4), and all these sub-blocks are 
rearranged into matrix form. The spatial/ temporal prediction is then computed and 
added to the residuals (block D2 in figure 4), and the obtained values are loaded into the 
pyramid (block E2 in figure 4). The pyramid can be restructured to an image at any time 
during this operation, yielding the obtained image so far. 

If segmentation is applied, the background will be transmitted at the end of the 
transmission of the inner image part This is for loss-less transmission. For lossy 
transmission the user can stop the transmission, thus disregarding the background. 
Transmitting the background is supported by dividing the background into four parts as 
indicated in figure 7a or by mapping the image as indicated in figure 7b. Each such part is 
raster scanned into a vector and the same coding operations presented above apply again, 
namely, decorrelation, adaptive sectioning, and entropy coding (i.e., Golomb-Rice 
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coding). Other compression-decompression methods of course can be applied within the 
^^ope of this invention. 

If windowing is applied, the received image at the user's location is a lossy 
representation of the original image. Upon the user's request, the error image (the 
difference between the original and the windowed image) should be coded and 
transmitted. This error image is coded using the same methodology as presented for the 
background transmission - decorrelation, adaptive sectioning, and entropy coding (i.e., 
Golomb-Rice coding). ' * 

For image group/ series, the order of transmission is as shown in figure 8. First, all 
the low-resolution levels are sent At the end of this stage, the client may view all the 
required images in an overview form using the basic version of the entire image set At 
the second stage, each of the images is updated by sending the next resolution level. As 
soon as a resolution level for a specific image is received, the image can be updated to the 
next interim version which is better than the current version. After several such steps, the 
images are obtained in error-less form on the user' s display 

Another option, instead of the loss-less entropy coding described above, may be 
implemented by applying the already existing JPEG routines within the browser software. 
This approach consists of optional (as before) windowing and/ or segmentation steps, 
followed by a pyramidal decomposition of the obtained image. Each resolution level is 
then compressed using the lossy JPEG algorithm. At the user, each such level is 
decompressed accordingly. Since lossy compression- decompression results in deeper 
compression ratios, and since the decompression routines are written in the computer 
native language, much shorter waiting periods are obtained at the user's end. As 
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described in detail for the windowing and segmentation operations, one final step of 
^psiduals transmission is required in order to support final loss-less representation of the 
original images at the user's workstation. 

In addition to the above described techniques, other methods can be applied within 
the scope of the present invention. All the above are examples of the invention, which is 
not limited to those methods. 

3. Image Acquisition Process - "Stamps" 

Using the insight gained in the explanations rendered until now, the image 
acquisition process itself can now be described in greater detail. As presented herein 
above, the user defines the specific medical case (patient, study, series, images) of interest 
through the use of network application queries into the server' s database. Selecting the 
case is done using the case identifiers which are usually, but not limited to, text or image 
icons. A typical CT case may contain 50-100 medical images. Out of all these images the 
goal is to supply the user with the images really needed for the purpose of drawing 
conclusions (diagnostic, second opinion, etc.) as fast as possible. Usually, out of the entire 
image case the user will require only a limited number of images and only a specific 
region of interest (ROT) in the limited number of images. Typically these requirements are 
case dependent and the user cannot decide which images and what part of these are really 
nee ded until the images are viewed. The protocol thus should let the user specify these 
requirements as soon as possible by supplying the user with interim information which 
will arrive fast and be sufficiently adequate to make these decisions. 

Upon selection of the medical image case the server starts to prepare (as an option) 
a very basic version of the entire medical case. This basic version of the images will be 
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referred to as "stamps'' or icons and will consist of a reduced version, which is visually 
^nilar, for every image in the case. The size, in bits, of these "stamps" is small compared 
with the size of the original images. The entire "stamp" collection is thus a reduced 
representation of the entire image case. Its size is selected to enable the user to visually 
select which images are of interest while retaining the small total size. This will assure 
that the entire reduced representation of the image case will arrive at the user in a 
relatively short time. Having presented the entire "stamp" collection to the user, the 
server awaits the user selection of a sublet of the entire image case. The sub-set can 
include the entire case but will typically include only several images. This sub-set of the 
image case will be referred to hereinafter as the "image group". In place of the icons, text 
can be used to describe the images. 

After the user selects the image group, the server prepares a pyramidal 
decomposition for each and every image in the group or volume process for the whole 
series. If segmentation and/ or windowing were selected, the server performs these 
operations at this stage. It then goes on and performs the rest of the compression chain 
(Dl through Fl in Fig.4) for the top level of the pyramid. This level is the most reduced 
version of the image and thus is also the smallest As an option, the server can utilize the 
"icons" which have been prepared in the previous stage for this purpose. Optionally, as a 
first stage, only the smallest representation of the image is sent from the server to the user. 
The user receives and displays the images. After, or even during, this recuperation stage 
the user can select either a smaller sub set of the group images and/ or smaller region of 
interest out of the image space. This serves as a finger query into the entire image data 
baseband is sent from the user to the server over the communication line. If no finer 
selection is required the user.is enabled to specify whether the visual level obtained so far 
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is sufficient, thus ending the image acquisition process. However, if a better visual level is 
^peded the acquisition process is combined to obtain the next level in the pyramid. 
Alternatively if the user does nothing the next level is sent As soon as the server gets the 
request it performs blocks Dl through Fl on the next level in the pyramid. This is done 
only to those images which are required and within these images only to that part of the 
image which is of interest (the ROI). Within the image group the order of compression 
and communication is presented in Fig. 8. The protocol preferably works on a resolution 
first basis. All the images in the image group may be brought to the same resolution level 
and only then the server advances to the next resolution level. Other orders of operation 
can be used without losing the generality of the invention. 

The above process is iterated for all resolution levels. The process is stopped either 
when the user indicates that the visual level is adequate or the entire image has been sent 
resulting in a perfect, loss-less, replication of the original image on the user's screen. 

The type of temporal prediction, (block Dl in Fig. 4) is selected by the server 
according to the user's computational capabilities. 

If segmentation and/ or windowing and/ or lossy compression was performed on 
the images, the user can request the server to complete the images to their loss-less 
representation. In such a case, the server will compress and transmit the needed 
information for the user to complete the images to their loss-less version. 

At each and every stage the user can choose to broaden the information query 
requirements, for example, by enlarging the number of images rather than reducing it In 
that case, the server will "backtrack" and send the required information to the user. 
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When tlie needed information has arrived and been presented to the user, the user 
^^resented with the option to acquire another medical image case from the server. 

4. The Man-Machine-Interface 

The man-machine interface (MMI) of the user serves as the means by which the 
user interacts with the system and as a display surface for the medical images. Being a 
medical images communication network based system, the MMI combines the known and 
familiar user interface environment of communication software with the tools needed for 
medical image processing. The goal is to give the user the tools to be part of the described 
image acquisition process as well as to enable the user to perform tasks regarding the 
medical image information. The MMI should achieve these goals with minimal to zero 
intervention or requirements of the user. For that end the entire user software is 
completely downloaded from the server to the user's machine and for the most part uses 
part of the communication software already part of the user' s machine. All this is done 
without any user intervention. This also makes user software updates and improvements 
irrelevant to the end-user. The user software relies heavily on the communication 
software (e.g. browser) already installed on the user's machine. This enables the user to 
operate on different machines with different computational and display capabilities. The 
first task of the user, upon loading the user software into the user' s machine is to 
automatically profile the machine and the network capabilities. This information is then 
relayed to the server and is used to select various parameters for the rest of the session. 
This is done without any user intervention. 

The MMI, the user is presented with, contains controls which are part of the image 
acquisition process as well as typical medical image processing tools. The image 
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acquisition tools include case specification tools, image selection tools, resolution level 
^^vancement tools, tools for windowing, zooming, panning, graphics and annotations, 
CINE, and so on. 

At all times, the user has full information as to what part of the entire medical 
image case is currently being viewed on the user' s display screen. This information 
includes, but is not limited to, image number, resolution level, loss-less indicator, region 
of interest indication, segmentation and window parameters, and so on. By these, the 
system makes sure the user is fully aware^of what exactly is being presented at all times. 

While the invention has been particularly shown and described with reference to 
preferred embodiments thereof, it is to be understood by those skilled in the art that 
various changes may be made in form and details without departing from the spirit and 
scope of the invention as defined in the appended claims. 
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Claims 

An interactive efficient method for a user to obtain data for 
diagnostic/review purposes from a server having access to stored 
data, said method comprising the steps of: 

connecting a user's computer to the server over a communication 
network, * 

requesting specific data for transmission from the server to the user's 
computer, 

transmitting the requested specific data over the network from the 
server to user's computer, 

receiving from the server application software (e.g. applet) for the 
user's computer, and 

using the application software received from the server to process the 
received requested data to produce images. 

An interactive efficient method for a user to obtain data for 
diagnostic/ review purposes from a server having access to stored 
data, said method comprising the steps of: 

connecting a user's computer to the server over a communication 
network, 

requesting specific data for transmission from the 




server to the user's computer, 

- ^^transmitting the requested specific data over the network 
progressively to the user's computer, 

processing the progressively received data to produce images of 
progressively improving quality, and 

using the produced improved images of progressively produced 
quality to decide on further processing of the images. 

3. An interactive efficient method for a user to obtain data for 

diagnostic/ review purposes from a server having access to stored 
data, said method comprising the steps of: 

connecting a user's computer to the server over a communication 
network, 

requesting specific data for transmission from the 
server to the user's computer, 

receiving from the server application software (e.g. applet) for the 
user's 

computer., 

progressively transmitting the requested specific data over the 
network, 

progressively receiving the data using the applet to process the 
received data and produce images of progressively improving quality, 
and 



10. The method of claims 2-9 wherein the step of progressively 
transmitting the requested data over the network comprises the steps 
of: 

recomposing the image into a pyramidal structure comprised of layers, 
said layers ranging sequentially from a layer having the least amount 
of data to a layer having the most data, 

transmitting the layers making up the pyramid individually starting 
with the layer with the least amount of data to enable the user to view 
the progressively improving image to decide on further transmission 
of the image. 

11. The method of claim 10 wherein the step of recomposing the image 
into a pyramidal structure includes the steps of reducing the image to 
provide the different layers at the transmitting end for progressive 
transmittal. 

12. The method of claim 11 wherein the reducing step comprises 
discarding all even rows and columns to create an image that is a 
quarter of the size of the original image. 

13. The method of claim 10 including the step of providing a first layer 
with reduced resolution in the pyramidal structure, 

providing remaining levels that contain residual values with increased 
resolution, 



and progressively receiving the data using the user's applet to provide 
images based on the received data of progressively improved 
resolution. 

14. The method of claims 1-13 including the step of compressing the 
requested data transmitted over the network and decompressing the 
received required data to provide images. 

15. The method of claim 14 wherein the compressing step includes 
spatially decorrelating the data by predicting each pixel at the current 
resolution using its spatial casual neighbors. 

16. The method of claim 14 wherein the compressing step includes the 
step of temporally decorrelating each pixel by predicting each pixel at 
the current resolution using the values of temporal neighbors from 
previous images. 

17. The method of claim 14 wherein the compressing and decompressing 
steps use entropy coding and decoding steps respectively. 

18. The method of claim 17 wherein the entropy coding and decoding 
steps are accomplished using Golomb-Rice entropy coding and 
decoding. 

19. The method of claim 16 where a predictor X used in predicting each 
pixel for a single image is equal to f(a,b,c). 

20. The method of claim 16 where a predictor X used in predicting each 
—pixel for a group of images equals fCa/b^al/bl/Cl/Xl). 



& • 

21. The method of claims 2-20 wherein the progressively improved images 
^ are used for selecting regions of interests in the images. 

22. The method of claim 13 including using adaptive slicing and entropy 
coding and decoding of each slice for progressively transmitting the 
requested specific data. 

23. The method of claim 22 wherein said step of adaptive slicing 
comprises the steps of: 

scanning the obtained residual matrix into a vector, 

partitioning the residual vector into variable length sub-vectors with a 
relatively homogeneous probability distribution function, 

estimating the local mean and variance on the vector, 

sectioning the vector on high transients, and 

coding each sub-vector separately. 

24 The method of claims 1-23 wherein the step of connecting the user 
computer to the server over a communication network comprises 
connecting over the Internet 

25. The method of claims 1-23 wherein the step of connecting the user 
computer to the server over a communication network comprises using 
a dial-up communication system. 

26. The method of claims 1-23 wherein the step of connecting the user 
computer to a server over the communication network comprises using 
networking facilities. 



• 



27. The method of claims 1, 3-26 wherein the step of receiving the server 



that includes a network computing language such as Java, ActiveX or 
similar network computing language. 

28. The method of Claim 2-27 wherein the stored data comprises data for a 
plurality of "postage stamp" images. 

29. The method of claim 28 including the step of using "postage stamp" 
images as a pick list for selecting which images are to receive no 
further data and which images are to receive further data. 

30. The method of claim 28 including the step of using the postage stamps 
as the layer containing the least amount of data in the pyramidal 
structure of claim 10. 

31. The method of claims 7-30 including the step of stopping the 
transmission on the user request 

32. The methods as described and claimed herein by way of example with 
reference to the accompanying drawings. 




application software comprises using a service program in the server 
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